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Abstract 



In this work we study the detection of weak stimuli by spiking neu- 
rons in the presence of certain level of noisy background neural activ- 
O , ity. Our study has focused in the realistic assumption that the synapses 

in the network present activity-dependent processes, such as short-term 
synaptic depression and facilitation. Employing mean-field techniques 
O^. as well as numerical simulations, we found that there are two possible 

noise levels which optimize signal transmission. This new finding is in 
contrast with the classical theory of stochastic resonance which is able 
^ ■ to predict only one optimal level of noise. We found that the complex 

\^ ' interplay between the nonlinear dynamics of the neuron threshold and 

1/^ , the activity-dependent synaptic mechanisms is responsible for this new 

■ phenomenology. Our results are confirmed by employing a more realistic 

' FitzHugh-Nagumo neuron model, which displays threshold variability, as 

, well as by considering more realistic synaptic models. We support our 

• findings with recent experimental data of stochastic resonance in the hu- 

I man tactile blink reflex. 
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■ 1 Introduction 



It is known that a certain level of noise can enhance the detection of weak input 
signals for some nonlinear systems. This phcnomcnom, known as stochastic 
resonance (SR), is characterized by the presence of a resonance peak, or a bell- 
shaped dependence, in the information transfer measurement as a function of 
the noise intensity. Stochastic resonance has been measured in a wide variety of 
systems, including bidirectional ring lasers [McNamara et al., 1988| , electronic 
circuits [Fauve and Hesl ot, 1983], and also in biological systems, such as cray- 
fish mechanoreceptor [Wiesenfeld et al., 1994| , or voltage-dependent ion chan- 
nels jBezrukov and Vodyanoy, 1995|. In the bra in, it has been found in different 



types of sensory neurons Longtin et al., 1991 Greenwood et al., 2000 , in the 
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hippocampus [Stancey and Durand, 2000 , in the brain stem Yasuda et al., 200"8] 



and in some cortical areas [Chialvo and Apkarian, 1993 Ho and Destexhe, 2000 



|Manjarrez et al., 2002 Fellous et al., 2003 . Although this resonant behaviour 



in neural systems has been extensively studied, the role that realistic neural 
features (such as nonlinearities in neuron excitability or accurate synaptic dy- 
namics) could have in signal detection in noisy environments is still unclear. It 
is known, for instance, that actual synapses present activity dependent short- 
term mechanisms that may strongly modify the postsynaptic neural response in 
a nontrivial way. Short-term depression (STD) and facilitation (STF) are two 
particularly relevant mechanisms that are usually present in activity depen- 
dent or dynamic synapses [Abbott et al., 1997| [Tsodyks and Markram, 1997| . 
The former of these mechanisms considers that the amount of neurotransmitter 
ready to be released — due to the arrival of an action potential (AP) — is limited. 
Thus, the synapse needs some time to recover these resources in order to trans- 
mit the next incoming AP. As a consequence, the postsynaptic current decreases 
for high input frequencies, producing a nonlinear effect in the postsynaptic re- 
sponse. On the other hand, synaptic facilitation is related with the influx of 
calcium ions through voltage-sensitive channels every time a presynaptic AP 
arrives to the synapse which increases the cytosolic calcium concentration. In 
addition, it is well known that cytosolic calcium ions can bind to some sensors, 
near the ready-releasable pool of neurotransmitter vesicles, and increase the re- 
lease probability [Bertram et al., 1996] . As a consequence, during the arrival of 
consecutive presynaptic APs, a residual calcium from the first AP is added to 
the following influx of calcium due to a second AP, which favours the neuro- 
transmitter vesicle depletion in the next release event. This yields to an increase 
(the so called synaptic facilitation) in the postsynaptic current. 

Both mechanisms, synaptic STD and STF can work together and interact in 
a non trivial way during synaptic transmission. For instance, it is well known 
that these two mechanisms play an important role in several complex phenomena 



in the brain, such as synchrony and selective attention Buia and Tiesinga, 2005 



and in the appearance of switching behaviour between different patterns of neu- 
ral activity [Torres et al., 2008] . In particular, they may be highly relevant 
in signal detection in noisy environments, as for instance in cortical gain con- 
trol [Abbott et al., 1997 or in spike coincidence detection, as recent studies 



suggest [Mejias and Torres, 2008 



Another important issue to consider during detection of weak signals by ac- 
tual neural systems is neuronal threshold adaptation. In primary visual cortex, 
for instance, neuronal adaptation seems to be responsible for contrast adaptation 



(via a strong hyperpolarization caused by high contrast stimuli) Wang et al., 2003 



Ahmed et al., 199"7l Dragoi et al., 2000 Greenlee and Heitger, 1988 , or for the 



scaling adaptation to varying stimuli in somatosensory cortex [Garcia-Lazaro et al., 2007 



Neural adaptation can be understood as a consequence of the nonlinearities pre- 
sented in the neuron membrane dynamics, a feature that has been captured (to 
some extent) by a large number of neuronal models [Izhikevich, 2004 , and in 



particular, it can be seen as neuron threshold adaptation Liu and Wang, 2001 



Chacron et al., 2004 



Similarly to what occurs with dynamic synapses, thresh- 
old adaptation can yield complex and new emergent cooperative phenomena 
when considered in large populations of neurons, as well [Horn and Usher, 1989[ 
[Torres et al., 2008[ . However, the complex interplay between dynamic synapses 
and threshold adaptation has caught little attention from researchers, despite 
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the computational implications that each one can have in different neural sys- 
tems when they are considered separately. 

In this work, we use a phenomenological model of dynamic synapses and a 
standard integrate-and-fire (IF) neuron model with variable threshold to study 
the interaction between threshold adaptation, STD and STF in the detection 
of weak (subthreshold) signals under a noisy environment. More precisely, we 
consider a system of N presynaptic neurons which transmit APs, within a Pois- 
son distribution with mean frequency /„, to a postsynaptic neuron through 
dynamic synapses. In these conditions, a weak and low-frequency signal is also 
transmitted to the postsynaptic neuron to study its response and the condi- 
tions in which SR occurs. Our results show that new phenomena can emerge 
as a consequence of the interplay between threshold adaptation and short-term 
synaptic processes. Concretely, this interplay induces the appearance of a second 
resonance peak at relatively high frequencies, which coexists with the standard 
SR peak located at low frequencies. The coexistence of these two resonance 
peaks allows the system to efficiently detect incoming signals for two well de- 
fined network noise levels. The precise frequency at which each one of these two 
resonance peaks appear is determined by the particular values of the relevant 
parameters involved in the dynamics of the synapses. Our results arc confirmed 
by employing a more realistic FitzHugh-Nagumo (FHN) neural model (which 
possess, due to its highly nonlinear dynamics, an internal threshold variability 
mechanism), as well as by considering more realistic synaptic models. Finally, 
we have compared the results of our study with recent experimental data which 
seems to shows two stochastic resonance peaks in the human tactile blink re- 
flex [Yasuda et al., 2008| . 



2 The model 

We consider a postsynaptic neuron which receives a slow, weak external signal. 
For simplicity, this signal is considered periodical. At the same time, the neuron 
is exposed to the uncorrelated activity of a network of iV = 200 excitatory 
neurons, which acts as a background noise term added to the external signal. 
The scheme of the system is showed in figure 1 . 

To simulate the membrane potential of the postsynaptic neuron, we employ 
the IF neuron model which can be expressed as 

rrn^^^-Vit)+R,„Iit) (1) 

at 

where V{t) is the membrane potential, Tm = 10 ms is the membrane time 
constant, and the neural input or excitatory postsynaptic current (EPSC) is 
given by /(<), which is multiplied by the input resistance i?i„ =0.1 G^l. As a 
consequence of the input current I(t), the membrane potential V{T) depolarizes, 
and when it reaches a certain threshold 9, an AP is generated and V{t) is reset 
to its resting value (which, for simplicity, we set at Vr ~ 0). After the generation 
of an AP, the membrane potential remains in its resting value for a short period 
of time, called the absolute refractory period, which we set at Tref = 5 ms. 

The neural input is constituted by the sum of two terms, namely I{t) = 
S(t) + In(t). The first term, S(t) = sin(27r/st), is the input weak signal, with 
fs = 5 Hz and dg = 10 pA being its frequency and amplitude, respectively. 
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The second term corresponds to the total synaptic current due to the N = 
200 uncorrelated presynaptic neurons, namely In{t) = ^ takes 

into account the noisy current introduced by the other neurons in the network, 
and its level is controlled by the mean firing rate of the network /„. This 
noisy current includes an activity-dependence of the synapses as proposed in the 
phenomenological model presented in [Tsodyks and Markram, 1997| . According 
to this model, the state of the synapse i is governed by the system of equations 

;) Xi{t) S{t - tsp) 
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where Xi{t),yi{t),Zi{t) arc the fraction of neurotransmitter in a recovered, active 
and inactive state, respectively (see [Tsodyks and Markram, 1997| for further 
details). Here, = 3 ms and Tree are the synapse inactivation and active 
neurotransmitter recovery time constants, respectively. The delta functions 
appearing in equation ^ take into account that an AP arrives to the synapse 
at fixed time t = tsp. The variable Ui{t) is an auxiliary variable such that the 
product Ui{t)xi{t) represents the fraction of available neurotransmitter that is 
released after the arrival of a presynaptic AP at time t or, from a probabilistic 
point of view, the neurotransmitter release probability at that time. Synaptic 
facilitation is introduced by considering the following dynamics for Ui{t): 

dUijt) UsE-u^{t) 

— — = h UsEl^ - Ui[t)\d(t - tsp). (3) 

at Tfac 

This equation considers the influx of calcium ions into the neuron near the 
synapse through voltage-sensitive ion channels [Bertram et al., 1996] . These 
ions usually can bind to some acceptor which gates and facilitates the release 
of neurotransmitters. Pure depressing synapses correspond to Ui(t) = Use 
constant (which is also obtained in the limit Tfae — > 0), where Use is the 
neurotransmitter release probability without the facilitation mechanism. We 
consider that the excitatory postsynaptic current generated by the synapse i 
is proportional to the amount of active neurotransmitter (i.e., that which has 
been released into the synaptic cleft after the arrival of an AP), namely Ii{t) — 
Ase Viit). 

As can be easily checked in equations (l2][3|) , in activity dependent or dynamic 
synapses, the degree of synaptic depression and facilitation increases with Tree 
and Tfac, respectively, and these levels are also controlled hy Use- On the other 
hand, static synapses (i.e., when synapses are not activity dependent) are ob- 
tained for Tree, Tfae 0. 

To complete the description of the system, we assume that the firing thresh- 
old of the postsynaptic neuron has its own dynamics given by 

Tg'^ ^ -6{t) + 5 + R,^I{t), (4) 
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which imphes an adaptation of neuron threshold with the incoming synaptic 
current I(t), along a characteristic time scale Tg = 800 ms. The constant in- 
put parameter 6 = 2 mV in equation ^ ensures that the firing threshold lies 
above the mean input current at stationary state, and it guarantees that the 
output spiking activity is driven by the current fluctuations. Such kind of dy- 
namics has been widely used to model threshold adaptation in many neural sys- 
tems IChacron et al., 2004]|Loxley and Robinson, 2007[p^ersi et al, 2004[|Liu and Wang, 2001 



Moreover, we assume that the signal S{t) is too weak to have an appreciable 
effect on the dynamics of the threshold, and therefore we set I{t) = In{t) in 
equation ([4]). To ensure physiological values of the neuron threshold, we also 
impose a minimum value for the firing threshold of 9m = 7 mV. 



3 Results 

As we have mentioned before, the phenomenon of stochastic resonance has been 
measured in neurons under different conditions and, in particular, in the cor- 
tex [Rudolph and Destexhe,"200T| [Fellous et al., 2003| |Ho and Destexhe, 2000 



|Manj arrez et al., 2002] . Using our IF neuron model with threshold adaptation, 
we studied the level of background noisy activity received by a postsynaptic 
neuron which improves its ability to detect an incoming weak signal. This sig- 
nal is considered weak in the sense that, if the level of noise is zero or sufficiently 
low, the neuron does not generate APs strongly correlated with the signal. In 
order to quantify the level of coherence between the input signal S{t) and the 
response of the postsynaptic neuron, we can employ a cross-correlation function 
as defined in [Collins et al., 1995] , that is, 

1 '•^ 



Co ^ (smit)) = y s{t)R{t)dt, (5) 

where T is the total recording time of each trial, typically much greater than 
the signal period /~^, and R{t) is the instantaneous firing rate of the postsy- 
naptic neuron. An example of stochastic resonance in the case of a presynaptic 
population with static synapses is shown in figure 2. For low noise frequencies, 
the neuron is not able to fire, and therefore, to detect the weak signal. This 
is reflected in the fact that Cq takes low values. However, when the noise fre- 
quency is increased, both noise and signal terms contribute to make the system 
follow the signal, that is, the neuron response becomes highly correlated with 
the stimulus. As a consequence of this, a maximum value of Co is reached. 
Beyond that point, the activity of the presynaptic neurons produces a high and 
noisy postsynaptic response, and the resonance parameter Cq decays with its 
characteristic shape. 

This typical resonance behaviour appears when synapses do not show any 
fast variability in their strength, or when the variation is only due to a slow 
learning processes, which we do not consider here. However, we must take into 
account that actual synapses show activity-dependent variability at short time 
scales, and this feature could modify the response of the postsynaptic neuron to 
the signal. In particular, since STD is a mechanism that usually modulates the 
high frequency inputs, one can wonder about its effect in the SR curve. In fact, 
our results show that this effect is quite notorious as can be viewed in figure 3A. 
The figure shows the emergence of bimodal resonances in the presence of STD. 
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More precisely, in addition to the standard SR peak, a second resonance peak 
appears at high frequencies and moves towards lower frequency values as the 
degree of depression increases. This second peak allows the system to efficiently 
detect the weak input signal among a wide range of high frequencies (note the 
logarithmic scale on /„). Therefore, this new resonance peak reflects that the 
neuron is able to properly detect the incoming signal for both low and high 
values of the mean network rates. We also observe that the location of this 
second resonance peak has a nonlinear dependence with Tree- To better visualize 
this effect we plot in figure 3B the behaviour of /* , defined as the noise frequency 
value at which the second resonance peak is located, as a function of Tree- We 
can observe in this figure that data from numerical simulation agrees with our 
mean-field prediction. In the following and unless specifically specified, we have 
considered a time window of ^ 10 seconds for the simulations of the SR curves, 
and we have averaged each data point over 30 trials. 

As well as STD, the facilitation mechanism is able to modulate the intensity 
of the postsynaptic response in a nonlinear manner for given presynaptic con- 
ditions. Following a similar reasoning to the one considered above, we expect 
synaptic facilitation to have and important effect in the signal detection prop- 
erties of the postsynaptic neuron under noisy conditions. This effect is shown in 
figure 3C, where depending on the value of Tfac, the resonance peak located at 
low frequencies can be tuned among different values of /„. It is worthy to note 
that the appearance of the low frequency peak is not induced by the presence 
of depression or facilitation mechanisms in the synapse, since it also appears for 
static synapses (see figure 2A). Therefore, it corresponds to the standard SR 
phenomena observed in many excitable nonlinear systems. However, its precise 
location in the frequency range is influenced by STF. Concretely, since the effect 
of facilitation is to potentiate the postsynaptic response, one should expect that 
levels of noise which arc too low to cause high Co values with static synapses 
would, in the presence of STF, contribute to the resonance. On the other hand, 
the noise frequency values which were optimal to cause SR in absence of STF, 
becomes too high in the presence of STF and provoke a decrease in Cq. Consid- 
ering these two effects together, one should expect a displacement of the first 
resonance peak towards lower values of /„ as Tfac increases, which is what we 
observe in simulations. Since the position of the first peak is highly sensitive to 
the value of Tfac, STF could have an important role for a precise discrimination 
of the network noisy activity level needed for the optimal detection of weak 
signals. The second peak, which is mainly caused by the depression mechanism, 
does not change its position when Tfac is varied, due to the prevalence of the 
STD effect over the STF at high frequencies. The dependence of the position 
of the low frequency peak, namely /"*", with the facilitation characteristic time 
is shown in the figure 3D. 

The appearance of these bimodal resonances is not exclusively due to the 
dynamical characteristics of synapses. Neural adaptation, which we have in- 
cluded in our model via a dynamical firing threshold, is of vital importance for 
the emergence of bimodal resonances. To illustrate this, we have computed sr 
curves for different values of t^cc arid an IF neuron with fixed firing threshold. 
The result is shown in figure 4A, where we can see that STD is not able to 
induce a second resonance peak when neuron threshold is considered constant. 
Instead of this, we found that Co docs not decay from its peak value to zero 
for high /„ values, but it stabilizes at a steady value C^{Trec)- Such high steady 
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value means that some level of coherence between the weak signal and the post- 
synaptic response is maintained for high mean rates. It is worthy to note that, 
for a particular value of Tree (500 ms in the figure), the value of Cg obtained is 
similar to its peak value, thus allowing a good detection over a wide range of 
background firing rate values. 

This saturation of Co for strong enough STD, which is due to the oversimpli- 
fication assumed by the IF model with fixed threshold, can be easily explained as 
follows. Firstly, our simulations show that, in order to have large values of Co, a 
necessary condition is that /„ w Vth/Ri-riJ, with /„ being the mean noisy input 
current. Secondly, in the presence of STD and for high background noise rate, 
the mean noisy input current /„ saturates at certain value /qo = lim/^^oo/„ 
— see expressions for the mean and peak value of the postsynaptic current in 
the supplementary text — which is infinity for Tree = and decreases as Tree in- 
creases. Moreover, for Tree sufficiently high (strong depression), the mean noisy 
current is near its asymptotic value loc, for a finite and relatively low noise fre- 
quency /„. As a consequence, there is a sufficiently high value of Tree for which 
In ~ loo ~ Vth/Rin- In this situation an optimal Cq value will be maintained 
over a wide range of network firing rates, as the figure 4A shows. 

Since short-term synaptic mechanisms alone are not able to induce bimodal 
resonances in simple IF neurons with fixed threshold, as we have already seen, 
the origin of this two-peak resonant behaviour must emerge from the interplay 
between these synaptic mechanisms and neural adaptation. We can sketch a 
simple explanation of such cooperative effect by considering that, for an ex- 
citable system displaying SR, a resonance peak is obtained when the strength 
of the fluctuations is approximately equal to some potential barrier height 
[McNamara and Wiesenfeld, 1989| . That is, if we define in our system the bar- 
rier height as A$ = 9 — a resonance peak will appear each time the 
condition i?i„cr„ ~ A$ is satisfied. Considering a threshold dynamics such as 
the one defined in equation Q, the barrier height can be approximated in the 
stationary state by a small constant (A<f> = A$rf ~ S) for large enough /„. Since 
the dependence of Rmi^n with /„ is non-monotonic for dynamic synapses (see 
the appendix for details), plotting together the expressions of i?mcr„ and l^^d 
as a function of /„ shows two well located crossing points, as the top panels of 
figure 4B illustrate. Each one of these crossing points is associated then with a 
maximum in Co (as we have argued above), and therefore a bimodal resonance 
is obtained. The local minimum in Co is due to a high number of erratic firings 
of the postsynaptic neuron, which is caused by high values of the fluctuations 
(compared with the barrier height) around the point where the local minimum 
appears. This feature is depicted in the top-left panel of figure 4B with a double- 
head arrow. Without such large fluctuations, the local minimum of Co would 
vanish and the bimodal resonance would be lost. For the case of an IF neuron 
with static threshold, the barrier height A(f> = A$s is a monotonically decreas- 
ing function of /„. In these conditions, a single crossing point between i?m(T„ 
and A$s is obtainejl, and therefore the SR curve presents a single peak, as the 

^If In <SC Vth/Rin the postsynaptic neuron is not firing at all, and if In 2> Vth/Rin the 
postsynaptic neuron is firing all the time. 

^For certain sets of values of the model parameters, two crossing points between the level 
of fluctuations and the barrier height can bo also found for a fixed neuron threshold. However, 
in such situations A<J>s is large and comparable with a. As a consequence, the local minimum 
of Cq cannot be obtained, and the SR curve remains with the characteristic single-peak shape. 
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bottom panels of figure 4B show. 

The appearance of bimodal resonances gives a high versatility to neurons as 
weak signals detectors. In actual neural media, populations of neurons could 
take advantage of such versatility, and they could use the high heterogeneity of 
synaptic properties |Wang et al., 2006] to organize groups of neurons with non- 
resonance, single-resonance or two-resonance peak behaviour. A phase diagram, 
which locates the repertoire of different behaviours in the space of synaptic 
relevant parameters, is shown in figure 5A. For realistic synaptic conditions, the 
three types of behaviour are accessible. The region P2' corresponds initially to 
two resonances, but the second resonance is usually located in an extremely high 
network rate (/* > 200 Hz), which means that the second resonance does not 
occur in realistic conditions. If we increase Tree (for a given value of Tfae), the 
system pass from a single-peak resonance behaviour (region P2') for low Tree, 
to the bimodal resonance phase (because increasing Tree implies lowering /*). 
After that, the system reaches a single-peak behaviour again (due to the fusion 
of the two peaks of the bimodal resonance into one peak). Finally, increasing 
Tree evcn morc would lead to a decrement of the detection ability of the neuron, 
leading to the zero-resonance phase. 

The fact that we considered a simplified system allowed us to derive a the- 
oretical approach, which confirmed the numerical results both for STD and 
STF, as we have already seen. However, we should consider whether bimodal 
resonances appear in more realistic conditions. For instance, we assumed as 
a first approximation that fluctuations in threshold dynamics have not a dra- 
matic influence in the appearance of the bimodal resonances. However since 
the SR phenomena depends strongly on noise properties this assumption could 
lead us to wrong conclusions. Therefore, to test our results in more realistic 
conditions, we consider that the dynamic threshold is driven by the noisy EPSC 
In{t); instead of being driven only by its mean value /„. The consequences of 
this modification do not have a dramatic effect on the resonant behaviour of the 
neuron, as can be seen in figure 5B. In the presence of threshold fluctuations, 
STD induces the appearance of a second resonance peak, as we previously found 
with a deterministic dynamic threshold. This second resonance peak appears 
for the same range of values of Tree and /„, which implies that our results are 
robust with a more realistic fluctuating threshold adaptation. 

The emergence of bimodal resonances is also maintained when one consid- 
ers a more realistic neuron model to simulate the response of the postsynaptic 
neuron. Although we have employed a dynamic threshold to include some of 
the nonlinear features of actual neurons into the IF neuron model, it should 
be convenient to test our findings by considering an intrinsic nonlinear neuron 
model which could present this type of adaptation without additional ingre- 
dients. A common model employed in the literature to model the nonlinear 
excitability properties of actual neurons is the FitzHugh-Nagumo neuron model 
[Koch, 1999| , which can be defined as 



where v(t) represents the postsynaptic membrane potential, 'w{t) is a slow recov- 



dv{t) 
dt 



r^e[v{t){vit) - a){l - v{t)) - w{t)] + Sit) + RInit) 



(6) 



dw{t) 
dt 



bv(t) — cw{t), 
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ery variable related with the refractory thne, and a ~ 0.001, h = 3.5 ms^^, c = 
1 ms~^, e = 1000 ms~^ are parameters of the model. With this choice of values 
for the parameters, the model is set in the excitable regime, the (dimensionless) 
voltage v(t) ~ 1 corresponds to lOOmF and time is given in ms. We also con- 
sider R = 0.1 G^lmV and t,„ = 10 ms. The terms S(t) and /„(i) are described 
as before, with cZg = 5. Wc have performed numerical simulations of the system 
presented in figure 1, but considering now this FHN model for the postsynaptic 
neuron. The results arc shown in figure 6A, where one can see that for large 
enough values of Tree a bimodal resonance also appears. The location of the 
second peak moves towards lower values of /„ as r^ec increases, as it was found 
with the IF model with dynamic threshold. The range of values of the noisy 
frequency /„ at which the second peak is located is also the same as with the 
previous models with threshold dynamics. 

It is necessary to demonstrate here that the FHN model presents several 
threshold adaptation properties which are similar to those we assumed for the 
IF neuron model with dynamic threshold. In order to check this, we define 
two types of temporal stimuli that the postsynaptic neuron receives: and 
hiii). The first stimulus, consists in a train of narrow (~ 2 ms) square 

pulses of frequency (that is, the signal frequency). We impose that each one 
of these pulses arrives to the postsynaptic neuron every time the signal Sify 
reaches its maximum value, namely dg. Similarly, the other type of stimulus, 
hi (t) , consists in a train of narrow {^^ 2 ms) square pulses also of frequency fs , 
each one of them arriving at the postsynaptic neuron when S(t) = —ds, that 
is, every time the signal takes its lowest value. We also set a constant input 
fjL, in such a way that the total input to the postsynaptic neuron is given by 
S (t) + n+hi{t) +h2{t) . For a given fixed value of /i, we can determine the value of 
the neural firing threshold by increasing the strength of the stimulus hi (t) (that 
is, the height of the narrow pulses) until an AP is generated as a consequence 
of such stimulus. This measure of the firing threshold will be denoted as 6i. 
Similarly, wc can perform a second estimation of the neuron threshold, namely 
^2, by varying the strength of /i2(t) until an AP is generated in response to 
this second stimulus. Both estimations of the firing threshold, as a function of 
the constant input /x, are shown in figure 6B. The figure illustrates two major 
features of the excitability properties of the FHN neuron model. The first one 
is that, independently of the value of /i, both estimations give almost identical 
results for the value of the neural firing threshold of the FHN neuron model. 
Since the only distinction between the stimuli hi{t) and hiit) is a difference in 
amplitude of 2 ds, which is due to the signal term, this result indicates that the 
weak signal docs not infiucncc the value of the firing threshold (independently 
of the value of the constant input fi). This confirms the assumption wc made 
for the IF model in equation The second major feature illustrated by the 
figure 6B is that the value of the firing threshold varies with fi a.s 6 ~ C + fi, with 
C being a constant. This dependence coincides with the steady-state value of 
the firing threshold obtained from equation ^ (sec the appendix). Therefore, 
the assumptions we made on the modeling of the threshold dynamics for the IF 
model are appropriate as is confirmed by more realistic neuron models, such as 
the FHN model, which incorporates nonlinear excitability properties. 

The robustness and generality of our previous results can be also tested by 
considering a more realistic model for the activity-dependent synaptic mecha- 
nisms. For instance, until now we have treated the synapses employing a stan- 
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dard deterministic model for the sake of simplicity. However, it is known that 



real synapses have a stochastic nature Dobrunz and Stevens, 1997 and their 



fluctuations can play an important role in neural computation Dobrunz and Stevens, 1997 
|Zador, 1998| , and therefore they should be taken into account. In particular, 
since the SR curves depend strongly on the noise properties, it is important to 
consider the additional source of noise due to synaptic fluctuations, since this 
could lead to a very different emergent behaviour in the system. In order to 
test our results, we have simulated our system using an intrinsically stochastic 
model of dynamic synapses presented in |de la Rocha and Parga, 2005] . This 
model considers that each connection between neurons has a number of func- 
tional contacts, or synaptic buttons, and this number is randomly chosen (for 
each particular connection) following a Gaussian distribution of mean M and 
standard deviation IS.m- In addition, the strength of each individual synaptic 
button is also randomly determined following a Gaussian distribution of mean 
J and standard deviation Aj. The release of a neurotransmitter vesicle from 
a synaptic button to the synaptic cleft, when an AP arrives at the button, is 
modeled as a random event. After that release, the recovering of the synaptic 
button is considered as a probabilistic event following a Poisson distribution 
with a typical time Tree- This probabilistic model gives the same mean values 
for the EPSC, but the fluctuations differ from the previous model (see figure 6D 
and the supplementary material for more details). As it is shown in figure 6C, 
this stochastic model induces the same phenomenology during SR experiments 
as those for the deterministic model described by That is, for the case of 

static synapses, a single resonance peak at low frequencies is obtained as usual, 
and when Tree is increased, a second peak appears at high frequencies with the 
resonance peak location moving towards low noise rates. We also tested our 
results by considering a conductance based description of the synaptic current, 
leading to the appearance of bimodal resonances as in the previous cases (data 
not shown). 

While this bimodal resonance behaviour could be difficult to measure directly 
in in vivo cellular recordings, several experimental methodologies are available to 
study the occurrence of this phenomenology in actual systems. For instance, re- 
cent experimental studies [Yasuda et al., 2008l|Simons-Weidenmaier et al., 2006| 
have shown that STD has a strong impact in the detection of weak tactile signals 
by caudal pontine reticular nucleus (PnC) neurons. This region of the brain stem 
is responsible for auditory startle reflex [Lingenhohl and Friauf, 1994| , and thus 
an auditory noisy input may act as a noise term, enhancing the tactile blink re- 
flex response to stimuli [Yasuda et al. , 2008| . In addition, as well as STD, neural 



adaptation seems to play a role in this brain area Lingenhohl and Friauf, 1994 



Pilz and Schnitzler, 1996| . As a consequence of these factors, PnC would be an 



excellent brain structure to search for the existence of bimodal resonances similar 
to those we have theoretically obtained. Thus, we have compared the predictions 
of our study with experimental datsU taken from [Yasuda et al., 2008| . In this 
work it is exposed that the ability of air-puff stimulations to an eyelid (input) 
to induce blinks (output) is improved by the addition of auditory white noise. 
To measure this improvement, a cross-correlation parameter equivalent to the 
one we used is employed. As one can see in figure 7, experimental data show 



^We have employed the experimental data from Tabic 1 of Ref. [Yasuda et al., 2008| , and 
we obtained the values of the cross-correlation function following the same protocol that the 
authors employed in his work. 
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clear evidences of two resonance peaks. These resonances are well explained 
with our FHN model receiving a weak signal and a noisy current modulated 
by STD, as indicates the good fitting between experiments and our simulation 
results. In order to relate the auditory noise intensity An (measured in dB) with 
the mean firing rate /„, we assumed two separate regions (for An > 60dB and 
for An < 60dB), and we also considered a linear relationship An = ai /« + 02 
for each region. This distinction was done in order to separate the effect of 
giant PnC neurons with medium {An < 60dB) and high {An > 60dB) thresh- 
old [Lingenhohl and Friauf, 1994| . However, other types of dependence (such 
as a linear dependence for all the range of An) are also plausible and does not 
affect the appearance of the two resonances from the experimental data. These 
results suggest that PnC neurons actually employ the two-resonance phenom- 
ena to increase their ability to detect weak tactile inputs over different auditory 
noise levels. 



4 Conclusions 



It is widely known that noise can have relevant and positive effects in many 
nonlinear systems in nature. These effects include noise-induced phase transi- 
tions |van den Broeck et al., 1994 van den Broeck et al., 1997| , stochastic dy- 
namics of domain growth [Ibanes et al., 2000] , or multiple types of stochastic 



resonance IMcNamara and Wiesenfeld, 1989|rWiesenfeld et al., 1994[rCollins et al., 1995| , 
to name a few. The particular case of stochastic resonance has been widely stud- 



ied in the context of biological systems Wiesenfeld et al., 1994 Bezrukov and Vodyanoy, 1995 



and the occurrence of this phenomenon in the brain is well established. More 
precisely, it is known that stochastic resonance mechanisms are present in many 
brain areas, such as the cortex |Ho and Destexhe, 2000 Manjarrez et al., 2002[ 
the hippocampus Stancey and Durand, 2000 , or the brain 
Therefore, it is highly relevant to address the influ- 



Fellous et al., 2003 



Yasuda et al., 2008 



stem 

ence that some features present in actual neural systems could have in stochastic 
resonance tasks. 

Short-term synaptic mechanisms are, in this framework, a good candidate 
to consider. It is known, for instance, that both STD and STF play an important 



role in the transmission of relevant correlations between neurons [Mejias and Torres, 2008 



in the temporal maintenance of information in persistent states of working mem- 
ory tasks [Mongillo et al., 2008 , in the recall of stored memories on attractor 
neural networks [Mejias and Torres, 2009 , or in the switching behaviour be- 
tween neural activity patterns Torres et al., 2008] . However, the interplay be- 
tween these two mechanisms, or between them and other neural adaptation 
processes, has not been fully understood yet. 

In this work we have considered the role of dynamic synapses in the detec- 
tion of weak signals by neurons embedded in neural networks, via a stochastic 
resonance formalism. To the best of our knowledge, this is the first study that 
shows the dramatic effect of the interplay between the dynamical nature of 
synapses and neuron adaptation mechanisms on the stochastic resonance prop- 
erties of neurons. More precisely, we have demonstrated that this interplay 
originates the appearance of bimodal resonances, where the location of the res- 
onances are related with the relevant synaptic parameters. While such bimodal 
resonances have been found in several natural systems jTessone et al., 2006[ 
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|Volkov et al., 2003] , their occurrence in neural media has not been reported up 
to date. 

Recent studies [Zalanyi et aL, 200T Yasuda et al., 2008 have also suggested 
a relevant role of STD in neural stochastic resonance, but the emergence of 
bimodal resonances, which is the crucial point of our study, is missed in these 
works. Our findings are also supported by experimental data taken from [Yasuda et al., 2008| 



and by other experimental works Lugo et al., 2008 . Several questions should 



be experimentally tested, though. An interesting prediction to test is, for in- 
stance, whether STF has the effect on the first resonance peak predicted by 
our results. The observed dependences of the position of the peaks with the 
synaptic characteristic time scales could be confirmed experimentally as well. 
Finally, the question of how these bimodal resonances can be measured in ac- 
tual cortical structures, and its effect in the collective dynamics of large cortical 
neural networks, constitutes an interesting issue that still remains open. 
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Appendix: Analytical derivation of the noise in- 
tensity 

In this appendix, we derive the analytical expression for the cross-correlation 
measure Co between the response of the postsynaptic neuron to a weak input 
signal in the presence of synaptic noise. First, we obtain the expressions for the 
noisy EPSC with dynamic synapses, for both the deterministic model and the 
stochastic model. After that, we obtain the expression for the mean firing rate 
of the IF postsynaptic neuron, needed to obtain a mean- field description of Cq. 

We consider a population of N presynaptic neurons firing uncorrelated Pois- 
son spike trains with a certain frequency /„. We assume that the synaptic 
current Ii{t) generated by an AP arriving at time t* in a particular synapse i is 
proportional to the fraction of active neurotransmitters in that synapse, namely, 
yi{t) — cf Eq. ([2|). In this situation the postsynaptic current at time t ^ t* -]~ t 
is given by 

Ii{T,t*) = Ipexp{-T/Tin). (7) 

Considering a stimulation with a stationary Poissonian AP train, the synaptic 
current at t ~ t* , namely Ip, can be substituted by an averaged stationary EPSC 
amplitude. One easily obtains from equations (OEl) that 

Ip = AsE UooXoo (8) 

where Wqo and Xoc are, respectively, the facilitation and depression variables in 
the stationary state, and their expressions are given by 

^ Use + Use T/ac fn 

1 + Use Tfac fn 
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a^oo = — ^ (10) 

We can compute the mean noise contribution of the current and fluctuations 
using the central Umit theorem. The following expressions are obtained 



I Nfnn 



(11) 

(12) 



where we assumed that Ti„ <^ Tree- Equations (jlip and p2[l allow to charac- 
terize the noisy input from the presynaptic neurons. The dependence of these 
quantities with /„ is shown in figure 8. We can also consider the more realistic 
model presented in |de la Rocha and Parga, 2005| , which takes into account the 
stochastic nature of synaptic release events. Following de la Rocha et al., 2004| , 
this model gives the same value for the mean current but assumes an expression 
for the EPSC fluctuations (for an uncorrelated noisy input) that is given by 



al = NAIJ^u.. 



OO OO J 71 



1 + A2 



[A/(l 



1] 



UoqTi 



OO ' rec 



= /2) 



(13) 



where AI is the number of synaptic functional contacts, J is the synaptic 
strength per functional contact, and Aj, Aj\/ are their respective standard 
deviations. 

With these expressions (taking the fluctuations either from the determinis- 
tic or from the stochastic model), one can obtain the mean firing rate of the 
postsynaptic neuron by solving the problem of calculating the escape rate of a 
fluctuation-driven particle with linear dynamics [Tuckwell, 1989 Brunei, 2000| . 
We define the quantities 



ye{t) 



e{t) - Rinin + S{t) 



Vr 



S{t) 



R 



(14) 



(15) 



and assume that the weak signal S{t) evolves slowly compared with the neuron 
dynamics. The firing rate of the postsynaptic neuron is then given by 



R{t) 



Tref 



ye{t) 



dz^/7rexp(z^)(l -|- erf(z)) 



vAt) 



(16) 



For the case in which we have a dynamic threshold, we can set dO/dt = in 
equation Q to obtain the stationary condition O^o = 9 = 5 -\- Rinin- On the 
other hand, for the static threshold approach we set 6{t) = 0,„. Equation (fTHll . 
together with the expressions of the EPSC and the threshold conditions obtained 
above, allows to evaluate the expression ([5]) and obtain our mean-field approach: 



Co(z^) 



fsds sin(27r/s) 



Tref 



Ve{t) 



dfcV^exp(fc2)(l +crf(fc)) 



yr(t) 



dt. 



(17) 



where we have set T = 1/fs- By evaluating numerically this expression, one 
obtains analytical curves which can be compared with the results from numerical 
simulations. 
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6 Figure captions 



Figure 1: Schematic plot of the system considered in our study. The postsy- 
naptic neuron (in yellow) receives a weak input periodic signal, and is exposed to 
the noisy background activity of other neurons (in blue). These neurons trans- 
mit Poissonian spike trains, of frequency /„, through dynamic synapses. Our 
aim is to determine how the synaptic properties can influence the detection of 
the weak signal by a postsynaptic neuron with nonlinear membrane excitability 
properties. 

Figure 2: (A) Characteristic curve of SR as a function of the mean network 
rate /„. Numerical simulations of the model (symbols) agree with our mean- 
field theory (solid line). (B) Several time series of the postsynaptic membrane 
potential which correspond to different input noise frequencies (marked with a, 
b, c), when the postsynaptic neuron is trying to detect a weak input signal. Here, 
we considered static synapses {Tree ~ Tfac ~ 0), Use = 0.4, Ase ~ 120 pA, 
/s = 3 Hz and a fixed threshold 6 ^ 10 mV. 

Figure 3: (A) Bimodal SR curves for several values of Tree, considering 
Use = 0.4 and Ase = 120 pA. The effect of STD in stochastic resonance is the 
appearance of a second resonance peak at certain frequency /* which decreases 
when Tree IS increased, as it is depicted in panel (B). The inset in panel (B) also 
shows the fitting in a clearer logarithmic scale for the vertical axis. (C) Bimodal 
SR curves for several values of Tfae, with Use = 0.1 and Ase ~ 350 pA. The 
panel also illustrates a decrease of the frequency /+, at which the first resonance 
peak appears, as Tfac is increased. This dependence is clearly depicted in (D), 
while the inset shows the same dependence with a logarithmic scale for the 
vertical axis. In all panels, data from numerical simulations are denoted with 
symbols, whereas lines correspond to mean-field predictions. 

Figure 4: (A) SR curves for an IF neuron model with fixed threshold 
6 = 8 mV receiving a weak signal and a noisy input modulated by depress- 
ing synapses, for Use = 0.5, Ase = 90 pA and several values of Tree- One can 
see that ignoring the threshold dynamics can lead to drastic modifications in the 
performance of the system (cf. figure 3A) . Numerical simulations (symbols) are 
supported with a mean field approach (lines). (B) Schematic plot that illustrates 
how a resonance peak appears when the amplitude of the voltage variations in- 
duced by synaptic current fiuctuations (that is, a = Rin<Tn) is comparable with 
the barrier height A<I> (see main text). In the case of an IF neuron model with 
dynamic threshold and in the presence of dynamic synapses, this occurs at two 
frequency values separated by a frequency range where a ^ A$ = A$f; (which 
induces sustained spiking activity and therefore decreases the coherence Co be- 
tween the two maxima). For an IF neuron model with fixed threshold, however, 
a is comparable with A<I>s only for a single frequency value which explains the 
emergence of a single resonance peak. 

Figure 5:(A) Phase diagram, obtained with our mean-field approach, which 
shows different regimes of the behaviour of the system, for Use = 0.1 and 
Ase — 120 pA. Labels PO, PI, P2 denote, respectively, regions in which zero, 
one, or two resonance peaks appear. The region P2' denotes values of the 
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synaptic parameters for which a second resonance appears, but at a frequency 
too much high to consider in reahstic conditions (that is, /* > l/T^e/ = 200 Hz). 
For Tree — *■ the typical single resonance peak is recovered. (B) Numerical 
simulations of the SR curves for an IF neuron model with STD and a noisy 
threshold adaptation, for Use = 0.2, Ase = 110 and different values of r^ec. 
As the figure shows, the conclusions for a deterministic dynamic threshold are 
maintained when we take into account threshold fluctuations. Each simulation 
point is averaged over 100 trials. 

Figure 6: (A) Numerical SR curves for a postsynaptic FHN neuron model 
receiving a weak signal and uncorrelated background noisy activity of frequency 
/„, for several values of Tree, Tfac = 0, Use = 0.5 and Ase = 15 pA. In order to 
estimate the firing times of the FHN model, the dynamics of the variable v{t) was 
thresholded at v = 0.8. (B) Estimation of the neuron firing threshold for different 
values of a constant input current ^, and employing two different measures (see 
the main text for details). (C) Numerical SR curves for several Tree values and 
Use = 0.5, when a more realistic stochastic model for the synapses is employed. 
We set the parameters of the stochastic model in M = 50, J = 3 pA, Am = 0.1 
and Aj ~ 1 pA. (D) Comparison of the standard deviation of the synaptic 
current for the two synaptic models employed in our study. The conditions are 
the same than those in panel C and Tree = 100 ms. The difference between 
these two expressions is about 60 % for high frequencies, although the second 
resonance peak is clearly obtained with both models. 



Figure 7: Comparison between experimental data from Yasuda et al., 2008] 



and numerical simulations of the FHN neuron model and an stochastic dynamic 
synapse model with J = 3 pA, Aj = 1 pA, M = 50, Am = 0.1, Use = 0.5 
and Tree = 500 ms. We assumed a linear relationship between auditory noise 
intensity and the mean firing rate (/„ = aiAn + 0,2-, with (ai,a2) — (6,-370) 
for An > 60dB and (01,02) = (0.1,-2.5) for A^ < 60 dB), although other 
dependences are possible and also show good agreement between experiments 
and simulations with realistic parameter values. Each simulation point has been 
averaged over 100 trials. The inset shows the same data in a linear scale. 

Figure 8: Mean EPSC as a fimction of the mean firing rate /„, with 
Use ~ 0.5, Ase ~ 70 pA and Tree — 500 ms. Numerical simulations (symbols) 
are supported by mean field results (lines). In the inset, we can see the good 
agreement between mean field and simulations for the EPSC fluctuations. 
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7 Figures 
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Figure 1: Mejias and Torres 
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Figure 3: Mejias and Torres 
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Figure 5: Mejias and Torres 
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Figure 7: Mejias and Torres 
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Figure 8: Mejias and Torres 
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